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ABSTRACT 





Ther ar several incident report systems designed for 
humanitarian assistance/disaster relief operations. The 
Smartphone Assisted Readiness, Command, and Control System, 


SPARCCS, is one which brings the availability of cloud 











computing and mobility of smartphone/tablet together. It 
provides a clear common operational picture in order to 


create situational awareness among participants. 





Initially, responders are not able to share video clips 
between each other and headquarters. This thesis proposes 
to add video share, capture and display capability to the 


system. 
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I. INTRODUCTION 


A. MOTIVATION 


Destructive earthquakes, wide ranging environmental 





catastrophes, gigantic wildfires or large scale terrorist 














attacks may result in overwhelming consequences’ that 


neither small groups of people or a single nation can 





respond to alone. Such crises may requir region-wide, 


nationwide or even international scale collaboration. 








However, this collaboration is inherently complex in 
itself. Routinely, creating situational awareness (SA) 
among the participants and evolving a general picture of 
the cooperative operation become two main concerns that 


affect ffectiv decision making, which will save more 








lives with relatively less cost. Fortunately, by means of 


commercially available off-the-shelf (COTS) products, 





particularly with video capability, it is possible to 





address these challenges. 


Although many definitions have been proposed so far, 


Mica R. Endsley describes “situational awareness” as: 





[T]he perception of the elements in the 
environment within a volume of space and the 
time, the comprehension of their meaning, and the 
projection of their status in the near future 
[as yes 








She proposes that situational awareness is comprised 





of three hierarchical phases [2]. The first step is the 
perception of the elements of a given environment. Here, 
status, attributes and dynamics of the elements should be 
perceived. The second step is comprehension of the current 


Situation. This involves the synthesis of disjointed 
1 





elements and understanding their significance. The third 
step is projection of the elements’ future actions. Knowing 


the future possibilities will as th decision making 





process [1]. 


Maintaining SA is a critical factor in successfully 





conducting a relief operation, becaus th situational 





parameters likely determin th ability of the decision 








maker to select an effective problem solving strategy [3]. 


The term common operational picture (COP) is defined 








by the U.S. Department of Defense as: 


a distributed data processing and exchange 
environment for developing a dynamic database of 
objects, allowing each user to filter and 
contribute to this database, according to the 
user’s area of responsibility and command role 
[4]. 











By definition, it is very interrelated with 





situational awareness. A common operating picture is the 





leading element in enhancing SA. It helps decision makers 
find answers for the questions, among many: what is 
happening? where is it happening? and who may contribute 


most? 


As a consequence, both situational awareness) and 








common operating pictur ar inevitab]l requirements for 





better response operation. Both shape the decision making 





process profoundly. Therefore, it is an urgent requirement 
to have gadgets in responders’ hands which enable faster 


information sharing. 


Today, the use of off-the-shelf hardware, such as 


smartphones and tablets, makes it possible to attain and 








maintain faster SA and provid real-tim COP for relief 
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operations. Smartphones and tablets are the most recognized 


examples of the COTS devices used in disaster response and 





relief operations nowadays. Their availability and vast 





features make them indispensible to the relief operations. 


The popularity of smartphones/tablets among people 





continues to increase. According to studies, people 
increasingly want to have a smartphone/tablet. This makes 
every smartphone/tablet owner a potential responder in a 
relief operation. Moreover, smartphones/tablets help 


maintain quick and real-time SA and COP with their GPS, 





accelerometer and built-in camera functions. Their 
multimedia capabilities, like video and image capture, 
provide especially accurate and detailed information of 


benefit to SA and COP development and maintenance. 


B. BACKGROUND 


As  smartphones/tablets continue to grow in their 


features, research into the capabilities of their usage 





increases. Today, studies based on usage of 
smartphones/tablets range from activity recognition [5] to 
coal mining [6]. One of the new applications of 


smartphones/tablets is in crisis management. 





Ther ar several systems in the market built for 








crisis management, which take advantage of benefits of 
smartphones/tablets in the operations field. The Smartphone 


Assisted Readiness, Command, and Control System (SPARCCS), 





is one of them, initially developed by two students from 
the Naval Postgraduate School for their thesis. This system 


leverages the resource-availability of cloud-computing and 





the utility of the Android smartphones/tablets to form a 


complete system. The system offers two different user 





roles, web-client and Android-client. In both roles, 


responders are able to create a mission, establish a point 





of interest, attach relevant images for a mission or a 





point of interest and s thes represented on a map. 





Although SPARCCS leveraged many of the smartphone/tablet 








capabilities, unfortunately, the system did not initially 





support video sharing among responders. For the video 
feature, xtra coding remained to be added by the 
developers. 

Cc. PURPOSE 


SPARCCS serves two fundamental roles, with respect to 


these efforts. First, it provides a context within which 





responders explore the domain of command and control so as 


to understand how technologic and procedural tools can be 





leveraged to generate timely, context-—based decisions that 





nabl ffectiv operations by military or disaster 
response organizations. Second, it provides a context 
within which the responders explore the architecture and 


implementation of mobile devices and their infrastructure 








necessary to support their operation. We believe that 


utilizing mobile video in any command and control system 

















will help to create faster, more accurate SA and COP in a 
relief operation. It will provide detailed information 
about an incident to a decision maker. Thus, it will help a 


decision maker to choose an appropriate problem solving 


strategy. As a command and control system, SPARCCS should 





not be devoid of a mobile-video feature. In this thesis, we 





propose adding mobile-video capability to SPARCCS. 





Therefor 


Ww aim to enable both web-client and Android- 


client users to capture, share and display video. 


D. ORGANIZATION 


This thesis is organized into the following chapters: 








Chapter I provides the introduction and overview 





of the thesis. 











Chapter describes existing command and control 





technologies built for a crisis management. The 








chapter highlights thos features and their 


strengths and weaknesses. 











Chapter summarizes the backbone structure of 











Smartphone Assisted Readiness, Command and 
Control System, and it describes the technology 


behind video feature. 








Chapter IV summarizes th arlier features of 
SPARCCS application, then describes the video 
capability of the system as an additional 


feature. 


Chapter V provides an objective summary of the 
video feature of the system and highlight 
possible improvements that can be made as further 


proposals. 
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II. EVOLUTION OF HUMANITARIAN ASSISTANCE/DISASTER 
RELIEF SYSTEM 





In the past several decades, the world has witnessed 


very destructive disasters, such as a tsunami in Japan 








(2011), an earthquake in Haiti (2010) and Hurricane Katrina 
in New Orleans (2005). They caused thousands of deaths and 
billions of dollars in property damage. To help keep both 





death tolls and the cost of damages low, an efficient 
response system should be deployed to such disaster areas. 


Thanks to technological improvements, systems are emerging 





which can be used in a Humanitarian Assistance/Disaster 


Relief (HA/DR) situation, to alleviate some of the problems 











of these tragedies. The Situation and Incident Report 








System (SIReS), Next Generation Incident Command System 











(NICS), Advanced Ground Information Systems (AGIS) and 





Smartphone Assisted Readiness, Command, and Control System 





(SPARRCS) are among those systems which are currently 





available for HA/DR missions. 


In this chapter, we provide an introduction to these 





systems and related technologies. 


A. SIReS—-SITUATION AND INCIDENT REPORT SYSTEM 


One implementation of an incident-report system is 





Northrop Grumman’s Situation and Incident Report System. 











STReS utilizes smartphone technology to provide real-tim 





reports from on-site personnel to automatically populate 


command center databases bh des Along with real-time 





Situational reporting (SITREP) with embedded pictures and 








video, the SIReS system has Blue Force tracking and barcode 


scanning, which may be used for evacuee tracking 
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capabilities. However, the system has some vulnerability 
from a structural point of view. Using existing cellphone 


infrastructure for data flow and a server-based approach 





are two such vulnerabilities. 








SIReS utilizes the commercial cell-phone 








infrastructure to create SA and COP. However, existing 











infrastructure can b rendered useless after severe 








disasters. This happened, for example, when a tsunami hit 


Japanese coastal cities in May, 2011. After the tsunami, 








the infrastructure of cities in that area of Japan was 





completely damaged. Therefore, it is important to use a 





backup wireless data service in conjunction with existing 


ones. 





Another weakness of STIReS lies in its server-based 








structure. STIReS uses Extensible Messaging and Presence 
Protocol (XMPP), which supplies messaging, presence and 


Extended Markup Language (XML) routing features, and a 








Geographical Information Science (GIS) database in order to 


manipulate geographical data. Hence, th ffectiveness of 








SIReS is restricted with customization of server and 


database. In contrast to server-based structure, cloud- 





based structure may increase the availability of system. 


B. NICS—NEXT GENERATION INCIDENT COMMAND SYSTEM 





The Next Generation Incident Command System, formerly 














called the Lincoln Distributed Disaster Response System 











(LDDRS), was developed by the Massachusetts Institute of 





Technology in partnership with the California Department of 








Forestry and Fire Protection (CAL FIRE) to enhance 


emergency response capabilities [8] in the USA. The system 





aims to increase the situational awareness of first- 
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responders and collaboration between participants by 
leveraging a web-based platform and a map-based 


environment. However, both features carry some problems. 





NICS is a web-based platform which allows participants 


to login via a web browser over a wireless network. 








Information about an incident, which can be real-time feed 
of airborne images, video, weather and Crikrcall. 


infrastructure as well as terrain information, is displayed 





on the client’s browser. However, a display format for the 
system is not available for a smartphone, which hinders 


rendering issues. Moreover, a mobile user is not able to 





store information in a local database. This may 
dramatically affect the efficiency of the system due to the 
fact that it causes rapid energy consumption at the mobile 


end. 





NICS has a map-based environment. This environment 








provides several graphical tools. It provides georeferenced 





virtual whiteboards, which can be used for collaboration. 





This tool facilitates communication among responders. For 





instance, a responder can create a team, send messages to 





another responder, and share maps and drawings with this 





tool. However, the map-based environment is restricted to 





the California region. Therefore, NICS is not applicable 





throughout the nation or world. 


Cc. AGIS—ADVANCED GROUND INFORMATION SYSTEMS 





Advanced Ground Information Systems developed a 








server-based emergency communication system between peers, 





which AGIS called LifeRing [9]. The system was started in 





2004 and has been under development for seven years. With 








its current capabilities, LifeRing provides useful features 


in order to create common operational pictures. 





LifeRing’s capabilities offer a wide variety of 


options to users. Firstly, the system leverages a 





combination of various wireless data services in the field 





of operation. It utilizes cellular network, Wi-Fi, military 





and land mobile radio, and satellite communication. 





Secondly, in AGIS, communication between the responder is 


encrypted. The system utilizes an advanced standard 





algorithm for encryption. Thirdly, the system is compatible 





with approximately 50 different types of maps, including 





known military maps. It is possible to switch between maps. 





LifeRing operates on Microsoft PC and Android-based 





smartphones/tablets. Using a PC and smartphone, the user is 
able to view his or her and the participants’ location, 


declare an emergency message which appears on all 





participants’ displays, and nter georeferenced text and 





images. Moreover, the user is able to send messages, open 


chat sessions, view video, and open whiteboards. On the 





other hand, thes features can be limited by an 
administrator. 
D. SPARCCS—SMARTPHONE ASSISTED READINESS, COMMAND , AND 


CONTROL SYSTEM 


The Smartphone Assisted Readiness, Command, and 
Control System (SPARRCS) is an implementation of command- 


and-control technology described in a previous thesis done 





at the Naval Postgraduate School [10]. The system leverages 


cloud computing and commercial off-the-shelf (COTS) 





products. Thes features bring great advantages from an 





HA/DR operations perspective. 
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SPARRCS is a Google cloud-based system. It uses the 
Google Web Toolkit (GWT) and Google App Engine (GAE). The 


GWT provides a developer nvironment for common object-— 





oriented code to be repurposed and optimized into web 





browser-—independent applications. The GAE provides a 
platform for developing and hosting web applications in 


Google managed data centers. With cloud computing, SPARRCS 





can easily overcom th issues encountered when dealing 
with a client-server based system. Moreover, SPARRCS takes 
advantage of Google Maps as a tool in order to create a 
common operational picture. Since Google Maps covers the 


entire world map, SPARCSS can be deployed easily throughout 








the world without having to preload maps, which makes it 
completely different from other systems that we have 
covered. The downside of this approach is that SPARCCS 
clients need to download maps in real-time, as needed, 
which makes the bandwidth requirement high in what might be 


a fairly constrained networking infrastructure. 


Using COTS mobile devices in order to create 





situational awareness among the participants in HA/DR 





operations is becoming common. Among those COTS phones, 
Android-based mobile devices such as smartphones’ and 


tablets lead the space, especially in the USA. According to 





results of a recent survey [11], 50 percent of 104 million 


subscribers in the USA are using Android-based smartphones. 





SPARRCS utilizes the Android-based smartphone/tablet as the 





target user-device for which to create missions, points of 


interest and display images for the sake of furthering 





Situational awareness. 


11 


E. SUMMARY 


Disasters such as tsunamis, earthquakes, hurricanes, 








etc. need an effective response system to be deployed in 





order to help manage response efforts so that more lives 


might be saved and assets are better managed to reduce 





costs. There are several systems currently being used for 











HA/DR, such as SIReS, AGIS’ LifeRing and NICS. SPARRCS 








differs from the others by being designed explicitly to 
leverage mobile and cloud computing potential. By adding 
video sharing capability, the system can be even more 


efficient for usage. 
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III. INFRASTRUCTURE BACKGROUND 


The efficiency of SPARRCS is based on the prominent 


technology it was built upon, which differs from other 








HA/DR implementations. In this chapter, we will describe 


the core infrastructure of SPARRCS which uses cloud 





computing, the Google App Engine and the Google Web 
Toolkit, and then discuss the background of mobile video 
capability improvement added for the purposes of the 


thesis, which includes BST player [12], VideoView and 





Camera application programming interfaces (API). 





A. CLOUD COMPUTING 


SPARRCS is a cloud computing implementation. The term 





“cloud computing” is a new style computing model that needs 
to be clearly defined to understand SPARCCS’ advantages 
with regard to the HA/DR field. 








According to the National Institute of Standards and 





Technology, cloud computing is defined as “a model for 


enabling ubiquitous, convenient, on-demand network access 





to a shared pool of configurable computing resources (e€.g., 
networks, servers, storage, applications and services) that 
can be rapidly provisioned and released with minimal 
management effort or service provider interaction.” Cloud 


computing offers explicit benefits as compared to client- 





server computing for HA/DR operations; significant among 
them are centralized data storage, faster management and 


reliable backups or data recovery. 


Cloud computing is also a popular trend in information 











technology (IT) and electronic commerce vendors. Major 
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players in this field, such as Amazon, Microsoft and 


Google, provide different service models to their 





customers. It is possible to categoriz thes servic 





models in three groups. 





In the Software as a Service (SaaS) model, the 
consumer is able to use the provider’s applications which 


run on a cloud infrastructure. This is typically actualized 





either via a web browser or a special program interface. 


Mail services like G-mail and Hotmail are good examples of 





this type of service model. 














In the Infrastructure as a Service (IaaS) model, the 





consumer is able to deploy/run arbitrary software over th 








provided computing resources, such as servers, storage, 





operating systems, networks, etc. Implementations like 


Amazon EC2 and Rackspace are examples. 


With the Platform as a Service (PaaS) model, consumers 
are allowed to deploy their own applications created using 
specialized programming languages, tools, and libraries 
supported by the providers. The Google App Engine and 
Google Web Toolkit are two such services provided by Google 
allowing the consumers to develop their own applications 


for PaaS implementation. SPARCCS, itself, is a good example 





in this category. It was developed by NPS students as a 
thesis project and deployed on the Google Cloud service in 


order to respond to specific HA/DR mission needs. The 





application, itself, can be configured by developers for 


further improvement. This thesis has expended the SPARCCS 





functionality by adding mobile video capability, which will 


be discussed later. 
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In conclusion, cloud computing has inherent advantages 
for HA/DR missions, including faster management, continuity 
of service, and flexibility. Currently, of the three major 
service models in the market, SPARRCS takes advantage of 


the PaaS model provided by Google. 


B. GOOGLE APP ENGINE AND GOOGLE WEB TOOLKIT 


Google App Engine (GAE) and Google Web Toolkit (GWT) 
are two tools, provided by Google, used by NPS thesis 
students to develop and configure SPARCCS to operate on the 


Google infrastructure. 


Google App Engine is ae platform which lets’ the 
developers run web applications on the Google Cloud 


service. With GAE, the processes of building, maintaining 





and scaling user created applications are easy. It supports 
applications written in the Java, Python and Go programming 


languages, the latter being a Google sponsored open-source 





language [13]. The Java programming language is used for 


th web servic side of SPARRCS; the Java runtime 








environment used is Java 6. The Google App Engine SDK for 
Java supports developing applications using either Java 5 
or 6. From a cost perspective, 1 GB of storage and 


5 million page views a month are provided for free. 


Google Web Toolkit is a development toolkit for 


building and optimizing complex, browser-based applications 





[14]. It has four elements. Firstly, a software development 





kit (SDK) that eases the problem that developers run into 





while writing web apps for multiple browsers. Secondly, 
Speed Tracer that helps diagnose problems in the _ web 


applications by visualizing metrics. Thirdly, Eclipse 
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Plugins that nabl developers to quickly design, build, 


optimize and deploy cloud-based applications written in the 

















Java Environment [Sys Lastly, GWI Designer, a bi- 
directional Java graphical user interface (GUI) that saves 
time by using an auto-generating Java cod featur 


However, from the thesis perspective, th developers of 





SPARCCS did not use this final feature. 


Cc. ANDROID OPERATING SYSTEM 


SPARRCS leverages COTS product advantages to rapidly 





develop and deploy application capabilities for the HA/DR 





operation field. Currently, the system utilizes the 


Android-based mobile operating system (OS) on a 





smartphone/tablet for the mobile end-user host platform. 


Although Android’s history dates back to 2003, it 
earned its existing fame as a mobile OS when Google stepped 
into this market with its company, Open Handset Alliance 


[16]. Currently, Android-based smartphones share 36% of the 





market and trends indicate that this share will 





Significantly increase in the near future. This brings 





visible efficacy to SPARCCS from the responder’s 





perspective. It means responders will immediately be ready 











to join the HA/DR mission because of existing Android-based 





smartphones in their hands. 





Android-based applications may contribute HA/DR 





operations with Android’s key components. It provides 
various methods for information input. With its media 
capture capability, it allows video, audio and picture 
input from its built-in camera and microphone. We will 


discuss the Android video featur in following sections. 
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Also, GPS and accelerometer hardware provide crucial data, 


such as location information and real-time actions of 








responders. Moreover, Android supports common wireless data 








services including: Bluetooth, Wi-Fi, GSM, EDGE, 3G and 4G. 





By means of thes services, Android supplies broad 


alternatives for transferring collected information. 





Further, Android supplements any database implementation 








with its own database, SQLite. In SPARCCS, SQLite is used 


to syne information on the mobile-end with information in 





the cloud. 


All in all, the Android OS presents reasonable 





benefits to SPARCCS developers for meeting the basic 





Situation awareness and analysis requirements of the HA/DR 





field. Detailed information about the Android video feature 








will be described in following sections. 





D. WEB SERVICES 





Web Service is a software system allowing machine-to- 





machine interaction over a network. In SPARCCS, interaction 
between an Android-based smartphone and a server is 
implemented using HTTP Posts and HTTP Requests using HTTP 
Servlets. On the other hand, for web-client to server 


interaction, Remote Procedure Calls are used. 





E. BST PLAYER 


Originally, SPARCCS was devoid of video capture and 





sharing/displaying features. We believed that adding the 





video capability to the current system would multiply its 





efficacy and make it more useful from a= situational 





awareness perspective. For this purpose, on the web-client 
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end, we chose the third party API built by Apache Maven, 
which is a software project management and comprehension 


tool, BST Player, to add video playback capability. 


Currently, the video API provided in GWT SDK, is 











under development and subject to change. As a third party 





API, the BST Player fills this gap with some unique 


features. The BST Player API makes most common media player 








plug-ins available to GWT applications [17]. It supports 








Windows Media Player, QuickTime, Flash Player, VLC Media 


Player, HTML 5 Video and DivX Web Player. This feature 





helps overcome a usual handicap that developers ncounter 








as a result of conflicting video format. Moreover, the API 





allows developers to customize an HTML-based player and use 


it as a cross-browser media player. Therefore, developers 





are able to build their own skin interface for general- 


purpose application. 





Consequently, the BST Player API provides necessary 





features for video support. It allows users to watch common 


video formats and create customized interfaces. 


F. ANDROID VIDEO FEATURE 


As previously mentioned, the Android OS video 


framework supports the display and capture of video in 





different formats. Therefore, it is easy to integrate its 


video feature into any application. By using the 





MediaPlayer or VideoView APIs, Android allows playing video 
from various sources, such as media files stored in an 
application’s resources, files in a file system or even a 


data stream arriving over a network connection [18]. 





Additionally, by utilizing MediaRecorder or Camera APIs, 





18 


Android allows the recording of video clips, of duration 


limited by the device hardware support. For the SPARCCS 





project, we have implemented VideoView and Camera APIs. 








Therefore, we will discuss the features of these two APIs. 


1. VideoView 


The VideoView (Figure 1) is a class which displays a 








video file. It can load videos from designated sources, 





such as resources or content providers. It can be used in 
any layout manager and provides various display options, 


such as scaling [19]. 


Tt A 


VideoView 








Figure 1. A typical VideoView example 
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To display video, the string format of the path for 


the designated video source should be configured into 





setVideoPath, a submethod of the VideoView class. In the 








SPARCCS project, the path is typically a uniform resource 
locator (URL) of a video source located in the Google Cloud 


infrastructure. 





The Display feature provided by the VideoView class 


offers adequate options for simple video implementation. 








Its onMeasure method determines the width and the height of 


the video and lets th developers resiz th video 








dimensions so that the video is properly adjusted for any 





size screen. 








In conclusion, VideoView class is a simple solution 


for displaying video on Android-based smartphones in the 








SPARCCS project. With methods provided under the VideoView 





class, any obstacles based on video dimensions can be 


resolved for any screen size. 


2. Camera 





Android supports various cameras and camera-features 





available on differing devices. Primarily, the API that 





controls device cameras is provided under the name of 





“Camera.” Developers can either customize their application 








through Camera API or utilize the existing Camera 








application provided by default. For our purposes, we tak 


advantage of the existing Android Camera application. 





Using the existing Android Camera application 


(Figure 2) is a quick way to capture video with minimal 








coding. Invoking the camera requires initiation of an 





abstract operation, called “intent.” To access the device’s 
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camera and its camera features, “Camera Permission” and its 
elements should be declared in the manifest file. By 


default, Android security architecture design does not 





allow any application to impact other applications [20]. In 








order to do that “permission” should be declared explicitly 





in the manifest file. The manifest file presents the 
essential information about the application to the Android 
system [21] such as describing components of the 
application, determining which process will host’ the 








application and declaring the minimum level of the Android 











API that the application requires. 


40 am 
02:06:04 °+O 


0 
x 





= -_ 
109) : 
4 


Figure 2. Existing Android Camera application 
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G. SUMMARY 


This chapter reviewed key technologies supporting the 





earlier SPARCCS project and then discussed further 
technologies available to improve the system by 


incorporating a video capture and video display capability. 





Cloud computing, the Google App Engine, the Google Web 





Toolkit web services, and the Android OS are the keystone 
technologies that provide a variety of capabilities and 


rapid prototyping to SPARCCS. Using the cloud model, 





particularly the PaaS model, offers faster management, 





continuity of operations and flexibility. Moreover, GAE and 





GWT simplify creating and maintaining a web application in 


the Google Cloud infrastructure. Furthermore, HTTP web 





services provides secure machine-to-machine communication 


in SPARCCS. Finally, the Android OS meets the general 





requirements of HA/DR missions with its versatility. 


As for improvements made to the system, key 
application programming interfaces such as BST player, 
VideoView and Camera, which make video capture, sharing and 
display available in SPARCCS, are discussed. BST player and 
VideoView help display common video formats for web-client 


and Android smartphone entities, respectively. Finally, 








Camera API enables video capture through Android 
smartphone. For next chapter, we will provide detailed 


information about these new additions from user interface 





perspective. 
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IV. EXTENSIONS OF SPARCCS 








In previous chapters, we have discussed current HA/DR 
implementations in the market, and the technology in 


SPARCCS. As earlier features of SPARCCS have been explained 











by developers in their theses, here we are going to explain 


new features of SPARCCS for the purpose of this thesis. 





Since SPARCCS offers two different client models, web- 








client or mobile client, we will explain new additions on 


both sides, one at a time. 


A. SPARCCS WEB-CLIENT 


On the web application side of SPARCCS, we have 
adhered to the original user interface flow. Therefore, 
while we added our extensions, we followed ae similar 
structural concept used for the image module. Hence, 
integrity of the web-browser-based version has been 


preserved. 


1. Initial Screen 


The user is taken to the main interaction screen 





(Figure 3), after the login process. The main screen 
consists of two principal panels, a map panel and a 


navigational panel. On the right side of the screen is the 





user map, centered on the user’s current location. As an 
additional feature, video icons are now displayed on the 
map, along with the mission, points of interest, responder 
and image icons. Thus, the user iS now aware of video 


captures sent from responders. 
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Figure 3. Main screen 


2. Video Panel 


Like other panels in the navigational panel, the Video 


panel (Figure 4) consists of three main sections: the 








Mission section, the Points of Interest section and the 


Responders section. 


The Mission section contains three radio buttons and a 


list box. The radio buttons enable the user to add a video 





capture to a selected mission from the list box, to view 





the video capture from a selected mission from the list box 


or to view all the videos from all missions. 
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Missions 

Add/Mission Options 

Points Of Interest 

Add/Point of Interest Options 
Responders 

Responder Options 
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Map Options 





Figure 4. Video panel 





In order to add a video capture to a selected mission, 
first, the user should select one of the current missions 
in the list box, and then select the “Add Video to a 


Mission” radio button. This will bring up a video form. To 





successfully upload a video, the user must fill in the 





“Name,” “Description,” and “Latitude” and “Longitude” text 
fields, and then click on the “Submit” button. This flow is 


illustrated in Figure 5. 
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Figure 5. Upload video flow 


With respect to viewing videos from a particular 


mission, a similar process is followed. First, the user 


selects a mission from the list box, and then selects the 


“See Videos From a Mission” radio button. This will 





bring 





up a gallery of standard video icons that represent, 











individually, unique video captures from the mission 


(Figure 6). 





Descriptions of the videos will be displayed in 


a popup window if a related icon is “moused-over.” 


Videos from Nus 


~s “© © © “© © 
a a a a a 
Se oe” Se Se Resa) eh) 
| 
o o o 
Sr (Oey ane. Video Description: 
Se Se Se 
~~ ~— ~—— G 


Close 





Figure 6. Video from Mission 
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Figure 7. Video display after clicking on an icon 


If an icon is clicked on, the video will be displayed 








in a Simple panel (Figure 7). If the current user is the 
creator of the mission, then the user has the option of 


deleting the video. 


There is also a globe button on this panel. This 
button directs the user to the video’s location on the map 


and allows the user to see essential information about the 





video within a bubble (Figure 8). If this bubble is 


expanded, all information about the video will be 





isplayed, as shown in Figure 9. The user can view the 





video by clicking the video icon. 
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Video Title: T 

Video Description: T 

Video Creator: MMM 

Video Mission: Nus 

Video Time:_01:27:55 06/09/2012 





Figure 8. Video on map 
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& 


Figure 9. Expanded video information 
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To see all videos from all missions, the user simply 


clicks on the radio button “See all Mission Videos” (Figure 





10), following the same actions from within the video 


gallery. 
Videos from All Missions 

es “% -~% ~ “© “s 
‘See ‘Sek ‘Sek See) ‘See ‘See 
— — — a ~—S — 
“2 “2 

Se) ‘Se 

— 

Close 
Figure 10. Video gallery of all mission videos 





B. ANDROID CLIENT 


1. Menu Button 





Due to its limited screen size, there is no 
navigational panel on the main screen of the SPARCCS’ 


Android addition; all functionalities are accessed by 











pressing the “Menu” button. In an arlier version, user 
options were limited to: “POI” (points of interest), 
“Users” (responders), “Missions” and “Image.” We added 





“Video” as a fifth option for the user, as shown in Figure 


ee 
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Figure 11. 


As with 


will bring up a submenu 


two different methods of action, 


“From Gallery” 


the video gallery, 


(Figure 13). 


Figure 12. 





other 


@ 5:05PM 


oA 


SPARCCSm 





Monterey 
Bay 


5, Castn 


® 








Marin 
Munici 


jarina Airpo 


S 


Pacific 
_ Grove Y 


Monterey ~. 


Del Monte 
Forest Monterey ~ 
Peninsula 


soe itport 


Missions Video 


Image 


Main screen with options menu 


options, pressing the “Video” 


(Figure 12). 
“From Gallery” and 


is self-explanatory; 


“Take” opens the device’s camera application. 
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This submenu offers 


it takes the user to 


a default location for video captures 


nps.edu.cs.D...CS (11) 


Videos (1) 





Figure 13. Video gallery 


2. Videos 


As previously mentioned, there are two ways for video 
to be entered into the system; either by using the device’s 
native camera or by selecting “Video Capture” in the video 


gallery. 





Through the native camera, captured video is saved to 
the default folder, video gallery. The VideoClient class 


retains the path to the video until the video is uploaded 








to the cloud. Once it is successfully uploaded, an URL is 


returned for the video’s newly assigned path on the server. 





Immediately after capturing a, VideoForm is opened. 
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The VideoForm screen displays video icon, form, and 
function buttons, from top to bottom (Figure 14). At the 


top is a video icon that contains a link to the video. By 





tapping on the icon, captured video is viewed by the 
VideoView class (Figure 15). Beneath the video icon there 
are three forms that allow related information about the 
video to be provided by the user, such as name, description 


and location notes. 


Ora 
SPARCCSm 


Assosciate with POI 


Cancel 





Figure 14. VideoForm 
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Figure 15. VideoView 


At the bottom, three buttons offer different options 
to the user about location of the video. The user can 
choose either to place the video in its current location or 


on another location on a map, or the user can choose to 





associate the video with a point of interest. Distinct from 
the third option, either of the first two options places a 
video icon on the map. An icon placed on the map is itself 


a link to the video. The user can see information related 





to the video by tapping the icon on the map. This action 





will open the VideoForm class instance. Additionally, both 








buttons will open further options for the user to save, 





move or cancel the video (Figure 16). 
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Figure 16. Save, move or cancel 


Cc. CONCLUSIONS 





With the new extensions, SPARCCS is now able to 
support video capture, display and sharing among 


responders. Responders can share video about an incident by 





means of either the web-based application or the Android 


application. With the help of video capability, SPARCCS 








will provide more detailed information and create a more 
accurate operational picture for the HA/DR missions. Thus, 
response to any specific incident may be conducted more 


properly. 
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Vv. CONCLUSIONS AND FUTURE WORK 


A. CONCLUSIONS 


Mobile video for HA/DR missions plays an important 





role in enhancing situational awareness among participants. 





A simple captured video from the operation field provides 





detailed information about an incident. Hence, it may lead 








to better understanding of the particular situation faced 


in an operation. Therefore, any command and control system 





designed to create a COP in order to maintain complete SA 


should benefit from mobile video. Although SPARCCS provides 

















excellent features for COP, initially it was devoid of 
video capture, share and display features. In this thesis, 
we added this feature and enhanced th ffectiveness of 


SPARCCS one step further. 


While programming the video capability, we faced 


several difficulties. We resolved some of them, but not 





all. There were some trade-offs that we had to decide. 


First of all, SPARCCS communication infrastructure between 





mobile hosts and the cloud server becam an obstacle for 





us. As previously mentioned, SPARCCS utilizes the Google 
Cloud platform. For security reasons, communication between 
responders and the cloud happens via HTTP connections. HTTP 
uses Transmission Control Protocol (TCP) as its underlying 


transport protocol. TCP provides a reliable, connection-—- 





oriented service to the invoking application [22]. However, 





LEERY S congestion control feature may affect video 





transmission adversely when packet loss rate is higher than 
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tolerated. Therefore, when a network is in a stressed 


state, it may take a relatively long time to transfer or 





display video in SPARCCS. 





Secondly, we encountered some problems when dealing 


with smartphone characteristics. Smartphones manufactured 





by different firms, even though they use the same Android 


OS, their characteristics differ from each other. From a 





video point of view, the screen size, resolution and color 





quality of the device became main concerns for us. A video 
capture with high resolution sometimes may cause problems 


on a receiving smartphone which has lower screen resolution 





or less computing power. We dealt with this problem by 
using factory settings as a reference for our coding. Thus, 


SPARCCS may continuously leverag features of upcoming 





smartphones in the future. 





In conclusion, we enhanced the efficiency of SPARCCS 
by adding video capture, share and display capability in 
this thesis. We added our coding both on the server and on 


the web application and mobile application side. Both web 











user and mobile user are now able to capture video, share 
it with participants and view it. With this additional 


feature, SPARCCS provides faster situational awareness and 





more functionality in creating COP. SPARCCS is better ready 





to meet general requirements in HA/DR operations. 


B. FUTURE WORK 


Although we enhanced the utility of SPARCCS, there are 





several things that can possibly be done to further enhance 








its functionality. To that end, we have provided a list of 


possible future upgrades. 
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Li} 


2) 


3) 


Picture editing—Augmenting further information to 








shared images will help convey intended messages 





and extend usefulness. For instance, drawing 
arrows or circles or scripting notes on an image 


will help draw attention of users to the point or 





information the sender wishes to emphasize. 





Different mobile OS-—SPARCCS leverages the 





functionality of Android-based smartphones in the 


operation field. However, Android is not the only 








operating system for the smartphones. There are 
several mobile operating systems such as Apple 
10S, Windows 8 and Blackberry 7.1, which may 
provide similar functionality for SPARCCS. We 
believe that if mobile application of SPARCCS is 
enhanced through these operating systems, the 


number of potential responders will increase. 





Thus, availability of SPARCCS will be affected in 


a good way. 


HTML5—Coding native applications for mobile users 


adds an extra burden from a system management 





perspective. As smartphone characteristics vary 
from screen size, resolution, and processing 


capability, the compatibility of the application 








becomes a big issue. It is possible to deal 


with this problem by converting SPARCCS into a 





device-independent application. Although it is 


still under development, HTML5 promises new 








opportunities for a device-independent 


application. Currently, HTML5 does not meet all 
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a) 


the functionality of SPARCCS. However, as: at 


improves, it is likely to meet all functionality. 





At that point, an HTML5-coded version of SPARCCS 











will be more efficient and flexible, regardless 


of which device the participants have. 


Real-time video sharing-Although adding video 
capture, share and display capability made 


SPARCCS more suitable for HA/DR missions, it is 








also useful to hav real-tim video streaming 


from the operation field. By receiving real-time 








feeds, decision makers at distant headquarters 
will be better able to follow the changing 


Situation in the field. 
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